A simple control task is to move a trolly back and forth while balancing a pole on top. This is not practically useful, but helps test different control strategies. In particular, it has been used as a test case for reinforcement learning.
Used in Chap. 5: page 77; Chap. 16: pages 260, 262
Pole balancing